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BACKGROUND OF THE INVENTION 

1. FIELD OF THE INVENTION: 

The present invention relates to an image 
processing apparatus for obtaining a high-quality image 
by processing image data captured by a CCD (charge-coupled 
device) area sensor using a complementary- color filter. 
The image processing apparatus may be used in a digital 
camera (e.g., an electronic still camera) or the like* 

2. DESCRIPTION OF THE RELATED ART: 

Conventionally/ it has been known that a 
complementary-color filter has a higher transmittance, 
and obtains a higher number of G-components obtained in 
extracting a luminance component, than those of a 
primary-color filter. Therefore, when a 

complementary-color filter is used in a CCD area sensor, 
a high-sensitivivity image data can be obtained. 

An exemplary CCD area sensor with a 
complementary- color filter will be described below by 
taking a color video camera as an example. Figure 15 
shows a complementary-color filter having pixel units. 
The complementary-color filter is provided at a 
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light-receiving element surface side of the CCD area 
sensor. The CCD area sensor is a color difference 
progressive type CCD, in which image data is read out in 
such a manner that a color signal is obtained as a color 
difference signal every scanning line and alternately 
between an odd-numbered field and an even-numbered field. 
Specifically, the CCD area sensor is scanned as follows. 
Referring to Figure 15, first, an odd-numbered field is 
read out in such a manner that the value of an odd-numbered 
pixel is added by the value of a subsequent even -numbered 
pixel (numbering is conducted in a vertical direction from 
top to bottom). Thereafter, a subsequent even-numbered 
pixel is read out in such a manner that the value of an 
even-numbered pixel is added by the value of a subsequent 
odd-numbered pixel, unlike the odd-numbered field. For 
example, in the case of an odd-numbered field, a signal 
is obtained on a scanning line CD in the order of Ye+Mg 
and Cy+Gr, and a signal is obtained on a scanning line 
CD in the order of Ye+Gr and Cy+Mg. In the case of an 
even-numbered field, a signal is obtained on a scanning 
line (D' in the order of Mg+Ye and Gr+Cy, and a signal 
is obtained on a scanning line (D r in the order of Gr+Ye 
and Mg+Cy. Hereinafter, such a signal is also referred 
to as a scanning line input when it is input to a subsequent 
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stage of an image processing apparatus. 

A relationship between Ye (yellow) , Cy (cyan) , Mg 
(magenta), and Gr (green) of the complementary-color 
filter of Figure 15, and three primary colors, i,e., R 
(red), G (green), and B (blue) is ideally represented by : 

Ye=R+G, Cy=G+B, Mg=R+B , Gr=G (6). 

The thus -read image data is processed by a CDS 
(Correlated Double Sampling) circuit for reducing noise, 
and then by an AGC (Automatic Gain Control) circuit for 
adjusting gain* The resultant image data is converted 
to digital image data by an A/D conversion circuit having 
a resolution of 10 bits, for example. The resultant 
digital image data is input to an image processing 
apparatus in which the digital image data is subjected 
to various kinds of image processing. Finally, the 
resultant image data is output as a video signal to be 
displayed. The CDS circuit, the AGC circuit, and the A/D 
conversion circuit are included in a scanning line input 
section 410 of a color difference progressive type CCD 
in Figure 16, This conventional image processing 
apparatus will be described below in more detail with 
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reference to "Digital Signal Processing System of 
Single-Chip CCD Camera for Business Use" , Toshiba Review , 
1994, Vol. 49, No. 1. 

Figure 16 is a block diagram showing an exemplary 
configuration of an image processing apparatus (signal 
processing system) in a conventional color video camera. 
Referring to Figure 16, a signal processing system 400 
of a color video camera includes: a horizontal-vertical 
contour emphasizing section 401 which receives a scanning 
line input of a color difference progressive type CCD; 
a low-pass filter (LPF) 402 which receives the scanning 
line input; a gamma correction section 403 which receives 
an output of the low-pass filter (LPF) 402; a color 
separation section 404 which receives the scanning line 
input; a white balance adjusting section (WB) 405 which 
receives an output of the color separation section 404, 
a gamma correction section 406 which receives an output 
of the white balance adjusting section 405; a color 
difference matrix section 407 which receives an output 
of the gamma correction section 406 and outputs color 
difference signals Cr and Cb; a constant luminance 
processing section 408 which receives outputs of the 
gamma correction section 403 and the color difference 
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matrix section 407; and an adder 409 which receives 
outputs of the horizontal-vertical contour emphasizing 
section 401 and the constant luminance processing 
section 408 and outputs a luminance signal Y* 

The horizontal-vertical contour emphasizing 
section 401 receives an output from the scanning line 
input 410 of the color difference progressive type CCD 
and performs horizontal-vertical contour emphasizing 
processing. The horizontal contour emphasizing 

processing is performed for neighboring image data on the 
same scanning line. For example, (Ye+Mg) - (Cy+Gr ) is 
calculated on the scanning line CD . Vertical contour 
emphasizing processing is performed for image data on 
neighboring scanning lines in a field. For example, 
(Ye+Mg) - (Ye+Gr ) is calculated on the scanning lines CD 
and (D. 

The low-pass filter (LPF) 402 receives an output 
from the scanning line input section 410 and cuts out a 
high-range luminance component to output a broad 
frequency luminance component Yl . The broad frequency 
component Yl is calculated in groups of four pixels for 
each scanning line in accordance with expression (7) below. 
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It should be noted that the center of the broad frequency 
component Yl is the center of four pixels in each scanning 
line. Calculation of expression (7) is carried out in 
groups of four pixels on the scanning line CD of 
Figure 15. 

Yl=Ye+Cy+Mg+Gr ( 7 ) 

The gamma correction section 403 receives the 
broad frequency luminance component Yl output from the 
low-pass filter 402 and performs gamma correction. By 
the gamma correction, an image is modified so as to fit 
characteristics of a display or printer from which the 
image is output . 

The color separation section 404 performs color 
separation as follows. Ye-, Cy- , Mg-, and Gr-components 
on the scanning line CD are assumed to be the same as 
respective Ye, Cy, Gr and Mg-components on the scanning 
line (I) neighboring the scanning line CD, although each 
pair of components have different positions. Under this 
assumption, Ye-, Cy- , Mg-, and Gr-components are 
separated. The separate Ye-, Cy-, Mg-, and Gr-components 
are converted to three primary colors, i.e., R-, G-, and 
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B-components in accordance with expression (6) above in 
groups of eight pixels , for example. 

Based on the R-, G- , and B-components obtained by 
the conversion of the color separation section 404, the 
white balance adjusting section (WB) 405 adjusts 
white -balance in accordance with the color temperature 
of illumination so as to correct the color of an image. 

The gamma correction section 406 subjects image 
data output from the white balance adjusting section 
(WB) 405 to gamma correction. 

The color difference matrix section 407 
calculates a low-frequency luminance signal Y2 (also 
called a constant luminance signal Y2) based on the R-, 
G-, and B-components in accordance with expression (8) 
below, and calculates color difference signals Cr and Cb 
in accordance with expression (9) below. 



Y2 = 0 . 3R+0 . 59G+0 . 11B ( 8 ) 
Cr=R-Y2 

Cb=B-Y2 (9) 
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The constant luminance processing section 408 
replaces a low frequency portion of the broad frequency 
luminance component Yl which has been subjected to gamma 
correction in the gamma correction section 403 with a 
low-frequency luminance signal Y2. This processing is 
referred to as constant luminance processing. 

The adder 409 adds a horizontal-vertical contour 
emphasizing processing signal output from the 
horizontal-vertical contour emphasizing section 401 to 
a luminance signal output from the constant luminance 
processing section 408 , and outputs the resultant signal 
as a luminance signal Y* 

As described above, the signal processing 
system 400 of the color video camera reads out image data 
by adding pixel data on two scanning lines as shown in 
Figure 15, so that a resolution is reduced. Nevertheless, 
a problem substantially does not arise, since the 
resolution of a display is as low as the resolution of 
the video camera. In the case of a digital still camera 
requiring a higher resolution, the signal processing 
system needs to read out pixel data for every scanning 
line. 
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For a complementary-color filter array as shown 
in Figure 15 or 2, an actual sampling frequency is set 
to fs=l/Ax=l/Ay where Ax represents a width of a pixel 
(pixel pitch) in a horizontal direction (x-direction) , 
and Ay represents a width of a pixel (pixel pitch) in a 
vertical direction (y-direction) ♦ 

According to sampling theorem, the highest 
frequency of spatial frequencies contained in an original 
image, which can be restored, is half the sampling 
frequency fs ( =1/Ax=l/Ay) . Therefore, frequency 
components higher than the highest restorable frequency 
fs/2 appear as noise. 

To avoid such a problem, an optical low-pass 
filter (anti-aliasing filter) is attached to a CCD area 
sensor. The optical low-pass filter cuts out frequency 
components higher than or equal to fs/2. Unfortunately, 
the optical low-pass filter is not ideal, so that 
frequency components lower than or equal to fs/2 are 
attenuated. Referring to Figure 8, graph a shows a 
frequency characteristic of an ideal low-pass filter (for 
cutting out frequency components higher than or equal to 
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fs/2). However, an actual low-pass filter has a 
frequency characteristic as shown by graph b. Graph c 
shows a frequency characteristic of a desired 
compensation filter for restoring high- range luminance 
components which are attenuated by the low-pass filter 
to approach the ideal frequency characteristic 
represented by graph a. In the present invention, a 
compensation filter having a frequency characteristic 
substantially represented by graph Dl is used to newly 
extract a middle-high-range luminance component and 
combine it with middle and high- range luminance 
components at a predetermined ratio. The term 
"middle-high-range" as used herein refers to an 
intermediate range between a middle range and a high range 
in a region less than or equal to the sampling 
f r equency f s . 

When for each pixel of the complementary- color 
filter array of Figure 2, three color components are 
estimated using interpolation, high-range luminance 
components are attenuated. Therefore, compensation of 
the attenuated high-range luminance components is 
essential so as to produce a sharp image. Typically, as 
shown in Figure 9, such compensation is carried out by 
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a combination of a frequency characteristic of a 
middle-range luminance component compensating filter 
(graph d) and a frequency characteristic of a high-range 
luminance component compensating filter (graph c) . In 
Figure 9, graph b represents a total frequency 
characteristic after a low-pass filter (anti-aliasing 
filter) and interpolation, and graph a represents an 
ideal frequency characteristic of an entire image 
processing system including compensation. 

In the above-described conventional technique, a 
middle-range luminance component and a high-range 
luminance component are compensated for by the frequency 
characteristic curve (graph d) of the middle-range 
luminance component compensating filter and the frequency 
characteristic curve (graph c) of the high-range 
luminance component compensating filter of Figure 9. A 
maximum amplitude of graph d is positioned at an angular 
frequency co = n/2 (corresponding to fs/4). A maximum 
amplitude of graph o is positioned at an angular 
frequency co = jt (corresponding to fs/2). Therefore, the 
middle-range luminance component is compensated for by 
graph d having the maximum amplitude at an angular 
frequency co = ji/2 while the high-range luminance 
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component is compensated by graph c having the maximum 
amplitude at an angular frequency co = at. 

However, when high-range luminance components in 
an image are emphasized by the high-range luminance 
component compensation in contour emphasizing processing 
for sharpening an image, noise components are also 
emphasized. Therefore, all components having an angular 
frequency co higher than jt (corresponding to fs/2) are 
noise. As a result, when the resolution of an image is 
increased, noise and jaggy components are made 
conspicuous . Jaggy refers to one kind of noise which is 
substantially the most conspicuous of various kinds of 
noise. Jaggy (or zip noise) in the shape of steps appears 
at a contour portion. 

SUMMARY OF THE INVENTION 

According to one aspect of the present invention, 
an image processing apparatus for processing 
complementary color image data output from an image 
capturing element including a complementary-color filter, 
comprises a middle-high-range luminance component 
compensation section for compensating for a middle- 
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high-range luminance component of a low- frequency 
luminance signal generated based on the complementary 
color image data such that the low- frequency luminance 
signal has substantially an ideal frequency 
characteristic which is lower than or equal to a 
predetermined frequency. As used herein, a "middle-high 
range luminance component" means a luminance component 
mainly containing middle -high range components, and a 
"low- frequency luminance signal" means a luminance signal 
mainly containing low-frequency components . 

With the above-described structure, a middle- 
high-range luminance component in a low-frequency 
luminance signal which is attenuated from an ideal 
frequency characteristic of a low-pass filter in a range 
of lower than or equal to a predetermined frequency (half 
of the sampling frequency , i.e- , fs/2) is compensated for . 
Therefore, noise and jaggy occurring in sharpening 
processing can be suppressed. 

According to another aspect of the present 
invention, an image processing apparatus for processing 
complementary color image data output from an image 
capturing element including a complementary-color filter, 
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comprises a middle-high-range luminance component 
extraction section for extracting a middle-high-range 
luminance component having a zero amplitude at an angular 
frequency co = Jt and a maximum amplitude at an angular 
5 frequency co between 3T/2 and jt from a first luminance 
signal generated based on complementary color image data 
of four neighboring pixels, and a first synthesis section 
for adding the middle-high-range luminance component to 
J5 a low- frequency luminance signal generated based on the 

yij 10 complementary color image data to generate a second 

'?? I 

%J luminance signal. 

ui 

AS, 

□ With the above-described structure, a middle - 

!?j high-range luminance component is compensated for, 

15 thereby obtaining images having a high resolution. In 

addition, noise and jaggy occurring in sharpening 

processing can be suppressed. 



In one embodiment of this invention, the 
20 middle -high-range luminance component extraction 
section uses at least one even-number- size filter to 
arithmetically process the first luminance signal. 



With the above -described structure, a middle- 
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high- range luminance component having the zero amplitude 
at an angular frequency co = jt and the maximum amplitude 
at an angular frequency co between jt/2 and jr can be easily 
obtained. 

In one embodiment of this invention, the even- 
number-size filter is a two-dimensional filter, and has 
coefficients symmetrical with respect to a x-direction 
and a y-direction. 

With the above-described structure , a uniform 
effect of filtering processing can be obtained, thereby 
making it possible to faithfully reproduce images. 

In one embodiment of this invention, the even- 
number- size filter includes a first low-pass filter 
having a differentiation capability and a second low- 
pass filter, and a difference between an output obtained 
by arithmetically processing the first luminance signal 
using the first low-pass filter and an output obtained 
by arithmetically processing the first luminance signal 
using the second low-pass filter is output as the 
middle-high-range luminance component . 
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With the above-described structure, operations 
in the x-direction and the y-direction can be separately 
performed, thereby reducing calculation scale. 
Therefore, the present invention can be easily realized 
by hardware. 

In one embodiment of this invention, the image 
processing apparatus further comprises a first luminance 
signal generation section for generating the first 
luminance signal by adding complementary color image data 
from four neighboring pixels out of the complementary 
color image data together . 

Complementary color data are added together by the 
complementary-color filter in groups of four neighboring 
pixels to obtain a middle-high-range luminance component 
extracting luminance signal Yin. Therefore, losses in 
high-range luminance components can be suppressed, 
thereby making it possible to obtain sharp images. 

In one embodiement of this invention, the image 
processing apparatus further comprises an interpolation 
section for calculating missing components for each pixel 
having Ye-, Cy- , Mg-, or Gr- component by interpolation 
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to obtain a complementary image signal before the 
low-frequency luminance signal is generated. The 
interpolation section calculates missing components by 
arithmetically processing the complementary color image 
data using an odd-number-size filter. 

With the above-described structure, when a 
middle-high-range luminance component of a low- frequency 
luminance signal is compensated for, the center of the 
middle-high-range luminance component is positioned at 
the center of each pixel. Therefore, the low-frequency 
luminance signal needs to be positioned at the center of 
each pixel. Otherwise, ghosts occur in reproduced 
images . 

In one embodiment of this invention, the image 
processing apparatus further comprises an RGB generation 
section provided at a subsequent stage of the 
interpolation section, for generating R, G and B image 
signals based on the complementary color image from the 
interpolation section . 

With the above-described structure, R, G and B 
image signals used in generating a low- frequency 
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luminance signal can be easily obtained from a 
complementary color image signal. 

In one embodiment of this invention, the RGB 
generation section calculates R, G and B image signals 
based on the complementary- color image signal output from 
the interpolation section in accordance with expression 
below: 

R\ /CnCl2Ci3Ci4\ /Ye\ 
G = f C21C22C23C24 }( jjM 
B/ \C31 C32C33C34/ NMg 

With the above-described structure, variations 
in characteristics of image capturing elements among 
manufacturers can be accommodated by adjusting the 
parameters Cij of the above-described expression. 

In one embodiment of this invention, the image 
processing apparatus further comprises a middle-range 
luminance extraction section for extracting a middle- 
range luminance component based on the second luminance 
signal, a high-range luminance extraction section for 
extracting a high-range luminance component based on the 
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second luminance signal, and a second synthesis section 
for adding at least one of the middle and high-range 
luminance components to the second luminance signal to 
generate a third luminance signal. 

With the above-described structure, by modifying 
a ratio of a middle-range luminance component to a 
high-range luminance component, the three-dimensional 
appearance (stereoscopic or stereophonc effect) of an 
image can be adjusted depending on user's preference. 

In one embodiment of this invention, the image 
processing apparatus further comprises a median filtering 
section for removing noise contained in a color difference 
signal generated based on the complementary color image 
data. The median filtering section includes a plurality 
of median filters having different sizes, the sizes of 
the median filter are switched depending on an amount of 
change in the color difference signal. 

With the above-described structure, median 
filters having different sizes are selected and used 
depending on the amount of change in a color difference 
signal, thereby making it possible to prevent occurrence 
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of pseudo colors. 

Thus, the invention described herein makes 
possible the advantages of providing an image processing 
5 apparatus which, by using a complementary-color filter, 
can obtain a high- sensitivity image with reduced noise 
or jaggy occurring in sharpening processing. 

These and other advantages of the present 
invention will become apparent to those skilled in the 
art upon reading and understanding the following detailed 
description with reference to the accompanying figures. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figure 1 is a block diagram showing a 
configuration of an image processing apparatus according 
to an example of the present invention. 

20 Figure 2 is a plan view showing a color array of 

a complementary- color filter. 

Figure 3 is a plan view showing a part of the color 
array of the complementary-color filter of Figure 2. 
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Figure 4 is plan view showing a specific example 
of a YeCyGrMg interpolation filter. 

Figures 5A and 5B are diagrams showing specific 
examples of first and second YH extraction filters Fl and 
F2 employed in a middle-high-range luminance component 
extraction section of Figure 1, respectively. 

Figure 6 is a diagram showing frequency 
characteristics of the first and second YH extraction 
filters Fl and F2 of Figures 5A and 5B, and a frequency 
characteristic of a difference between the frequency 
characteristics of the first and second YH extraction 
filters Fl and F2 . 

Figures 7A and 7B are diagrams showing a specific 
example of a middle-range luminance component extracting 
filter and a specific example of a high-range luminance 
component extracting filter, respectively. 

Figure 8 is a diagram showing frequency 
characteristics of an optical low-pass filter and a 
compensation filter . 
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Figure 9 is a diagram showing frequency 
characteristics of filters compensating for middle-range 
luminance components, middle-high-range luminance 
component, and high-range luminance components. 

Figure 10 is a diagram showing specific examples 
of filters (A) through (E) which are represented by 
one -dimensional filters . 

Figure 11 is a diagram showing frequency 
characteristics of a middle-high-range luminance 
component extracting filter, a high-range luminance 
component extracting filter, and a middle-range luminance 
component extracting filter. 

Figure 12 is a diagram showing frequency 
characteristics of a low-frequency luminance signal YL 
and an input luminance signal Yin of the present 
invention. 

Figure 13 is a diagram showing frequency 
characteristics of a low- frequency luminance signal YL 
and a luminance signal (YL+YH) after a middle-high range 
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luminance component is compensated for, of the present 
invention. 

Figure 14 is a diagram showing frequency 
characteristics of a luminance signal (YL+YH), a 
high-range luminance component compensating filter, and 
a middle-range luminance component compensating filter 
of the present invention. 

Figure 15 is a plan view showing an array of a 
complementary- color filter for a video camera. 

Figure 16 is a block diagram showing an exemplary 
configuration of a signal processing system of a 
conventional color video camera. 

Figure 17 is a diagram showing a specific example 
of a single YH extraction filter employed in the 
middle-high-range luminance component extraction 
section of Figure 1. 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, the present invention will be 
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described by way of illustrative examples with reference 
to the accompanying drawings. 

Figure 1 is a block diagram showing a 
configuration of an image processing apparatus according 
to an example of the present invention. Referring to 
Figure 1, an image processing apparatus 1 includes: an 
optical low-pass filter 2; a complementary color CCD area 
sensor 3; a low-frequency luminance signal generating Ye, 
Cy, Gr, Mg interpolation section 4 (hereinafter referred 
to as a low- frequency luminance signal generating 
interpolation section 4) for interpolating components; 
an RGB generation section 5; a white-balance adjustment 
* gamma correction section 6; a low-frequency luminance 
signal generation section 7 (hereinafter also referred 
to as a constant luminance signal generation section); 
a color difference signal generation section 8 for 
generating color difference signals Cr and Cb; and an 
adaptive median filtering section 9. 

The optical low-pass filter 2 cuts out high-range 
luminance components higher than or equal to 1/2 of an 
actual sampling frequency fs. The sampling frequency fs 
is equal to 1/Ax=l/Ay where Ax and Ay are a pixel pitch 
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as shown in Figure 2. 

The complementary color CCD area sensor 3 
includes a plurality of light -receiving elements arrayed 
in a matrix, and a complementary-color filter disposed 
at a light -receiving element surface side thereof. The 
complementary- color filter has, for example, a color 
array as shown in Figure 2 . Image data read out from the 
complementary color CCD area sensor 3 is processed by a 
CDS circuit for reducing noise, and then by an AGC circuit 
for adjusting gain. The resultant image data is 
converted to digital image data by an A/D conversion 
circuit having a resolution of 10 bits, for example. The 
digital data is output to the low-frequency luminance 
signal generating interpolation section 4. 

The low-frequency luminance signal generating 
interpolation section 4 evaluates missing components for 
each pixel of the image data from the complementary color 
CCD area sensor 3 by interpolation. Figure 3 shows a 
complementary color array. For example, when a missing 
component is a Gr component, the missing component is 
evaluated by interpolation using expressions ( 11 ) through 
(13) below. Ye, Cy, and Mg-components each have the same 
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arrangement pattern as that of Gr components, the same 
interpolation method as that for Gr components is applied. 

Gr5=(Gr4+Gr6)/2 (11) 
Gr7 = ( Gr4+Grl0 )/2 (12) 
Gr8= (Gr4+Gr6+Grl0+Grl2 ) /4 ( 13 ) 

The above -described interpolation is carried out 
by a YeCyGrMg interpolation filter shown in Figure 4 
included in the low- frequency luminance signal generating 
interpolation section 4. The YeCyGrMg interpolation 
filter is an odd-number-size filter having 3 pixels x 3 
pixels where pixel data to be interpolated is positioned 
at the center of the pixel. 

A method for using the YeCyGrMg interpolation 
filter will be described below. For example, in the case 
of the complementary- color filter array of Figure 3, Ye5, 
Cy5 and Mg5 are sequentially evaluated by the following 
expressions . 

Ye5=(l/4)xYel+(l/4)xYe3+(l/4)xYe7+(l/4)xYe9 

Cy5=(l/2)xCy2+(l/2)xCy8 

Mg5=lxMg5 
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A reason a 3 x 3 pixel filter is used as the YeCyGrMg 
interpolation filter is that the use of a filter having 
more than 3 pixels x 3 pixels in interpolation may lead 
to a reduction in resolution and color reproductivity . 
Moreover, interpolation cannot be carried out using a 
filter having a size of 1 pixel x 1 pixel. Therefore, 
a filter having a size of 3 pixels x 3 pixels is most 
preferable. A reason for the use of an odd-number-size 
filter will be described later. 

The RGB generation section 5 generates R, G and 
B image signals including respective primary colors (R, 
G and B) which are calculated in groups of 8 pixels in 
accordance with expression (14) below based on Ye-, Cy- , 
Mg- , and Gr-components of a complementary color image 
signal including components obtained by interpolation in 
the low-frequency luminance signal generating 
interpolation section 4. 

Ye=R+G, Cy=G+B, Mg=R+B , Gr=G (14) 

The white-balance adjustment • gamma correction 
section 6 subjects the R, G and B image signals to 
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white-balance adjustment which is carried out in 
accordance with the color temperature of illumination so 
as to correct the color of an image, and subjects the 
resultant R, G and B image signals to gamma correction. 

The low- frequency luminance signal generation 
section 7 calculates a predetermined-weighted sum of the 
R, G and B image signals obtained by the RGB generation 
section 5 to generate a low-frequency luminance signal YL . 
In this example, the low-frequency luminance signal YL 
is calculated based on the R, G and B image signals in 
accordance with expression (15) below. In the present 
invention, as is different from the signal processing 
system of the color video camera described in the 
DESCRIPTION OF THE RELATED ART section, interpolation is 
carried out for each pixel, so that the generated 
low-frequency luminance signal YL has a higher 
resolution . 

YL=0.3R+0.59G+0. 11B (15) 

The color difference signal generation section 8 
calculates the color difference signals Cr and Cb based 
on the R-, G-, and B-components in accordance with 
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expression (16) below. Since interpolation is carried 
out for each pixel, the resultant color difference 
signals Cr and Cb have low color noise. 

5 Cr=R-YL 

Cb=B-YL (16) 

In order to suppress color noise due to the color 
difference signals Cr and Cb, the adaptive median 
filtering section 9 selects a pixel region of 5 pixels 
x 5 pixels when variations in the color difference 
signals Cr and Cb are small, and selects a pixel region 
of 3 pixels x 3 pixels (a total of 9 pixels) when variations 
in the color difference signals Cr and Cb are large, and 
processes the color difference signals Cr and Cb, in 
accordance with expression (17) below. 

When variations in the color difference 
signals Cr and Cb are small, a median of the color 
20 difference signals of 5 pixels x 5 pixels (a total of 25 
pixels ) is calculated in accordance with expression ( 17 ) . 
The color difference signal of a pixel, which is 
positioned at the center of the 5 pixels x 5 pixels, is 
replaced with the resultant median. When variations in 
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the color difference signals Cr and Cb are large , a median 
of the color difference signals of 3 pixels x 3 pixels 
(a total of 9 pixels) is calculated in accordance with 
expression (17) . The color difference signal of a pixel, 
which is positioned at the center of the 3 pixels x 3 pixels, 
is replaced with the resultant median. A pixel region 
is shifted by one pixel in a horizontal or vertical 
direction # and a similar calculation is carried out. 
Such processing is repeated for all pixels. 

Cr=Median5x5 {Cri j } 
Cb=Median5x5 {Cbij} 
(Max-Min)^Th l<;i, j<;5 

Cr=Median3x3 {Cri j > 
Cb=Median3x3 { Cbij } 
(Max-Min)>Th lsi, j<;5 (17) 

In expression (17), Max is the maximum value of 
the color difference signals Cr and Cb in a 5 x 5 pixel 
region, and Min is the minimum value of the color 
difference signals Cr and Cb in the 5x5 pixel region, 
and Th is a threshold value. 
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The image processing apparatus 1 further 
includes: a middle-high-range luminance component 
compensating luminance generation section 10; a 
middle -high -range luminance component extraction 
section 11; a multiplier 12 and an adder 13 (first 
synthesis section); a middle-range luminance component 
extraction section 14; a high-range luminance component 
extraction section 15; and multipliers 16, 17 and an 
adder 18 (second synthesis section). The middle- 
high-range luminance component compensating luminance 
generation sectionlO and the middle-high-range luminance 
component extraction section 11 constitute a middle- 
high-range luminance component interpolation 
section 20 . 

The middle-high-range luminance component 
compensating luminance generation section 10 generates 
a middle -high -range luminance component extraction 
section input luminance signal Yin (hereinafter referred 
to as an input luminance signal) by adding together Ye-, 
Cy- , Mg-, and Gr-components (complementary color image 
data) in groups of four pixels. Specifically, before the 
middle-high-range luminance component YH is extracted, 
the input luminance signal Yin is generated from Ye - , Cy- , 
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Mg-, and Gr-components (complementary color image data) 
in groups of four neighboring pixels in accordance with 
expression (18) below. 

Yin=* ( Ye+Cy+Gr+Mg ) / 4 (18) 

In this case, as can be seen from expression (18) , 
the input luminance signal Yin is calculated using an 
even-number-size filter having a size of 2 pixels x 2 
pixels ♦ Therefore, each pixel data is positioned between 
pixels * 

The middle -high- range luminance component 
extraction section 11 extracts the middle -high -range 
luminance component YH from the input luminance 
signal Yin generated by the middle-high-range luminance 
component compensating luminance generation section 10 
using first and second YH extraction filters Fl and F2 
shown in Figures 5A and 5B, Specifically, the 
middle-high-range luminance component extraction 
section 11 outputs a difference between outputs of the 
first YH extraction filter Fl having 6 pixels x 6 pixels 
(Figure 5A) and the second YH extraction filter F2 having 
4 pixels x 4 pixels (Figure 5B) as the middle-high-range 
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luminance component YH. Thus, the first and second YH 
extraction filters Fl and F2 receive the same input. 
Therefore, the output of the second YH extraction 
filter F2 is subtracted from the output of the first YH 
extraction filter Fl, so that high frequency components 
of the middle-high-range luminance component YH have low 
noise. In the first and second YH extraction filters Fl 
and F2 of Figures 5A and 5B, x indicates an operation in 
a horizontal direction while y indicates an operation in 
a vertical direction. 

The first YH extraction filter Fl of Figure 5A has 
the following features. The first YH extraction 
filter Fl is a low-pass filter having a differentiation 
capability (including negative coefficients) . The x and 
y-directions of the first YH extraction filter Fl both 
have an even number size (8 pixels x 8 pixels, 10 pixels 
x 10 pixels, or the like). The shape of the first YH 
extraction filter Fl is preferably a square (having the 
same number of pixels in the x and y-direction) . 
Alternatively, the first YH extraction filter Fl may be 
in the shape of a landscape (the number of pixels in the 
x-direction is more than that in the y-direction) in order 
to emphasize the x-direction, or may be in the shape of 
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a portrait (the number of pixels in the x-direction is 
less than that in the y-direction) in order to emphasize 
the y-direction. Further, coefficients are symmetrical 
with respect to the x and y-directions . The second YH 
extraction filter F2 of Figure 5B has the following 
features. The second YH extraction filter F2 is a 
low-pass filter (including only positive coefficients). 
The x and y-directions of the second YH extraction 
filter F2 both have even number size (which is less than 
or equal to the size of the first YH extraction filter Fl 
of Figure 5A) . The shape of the second YH extraction 
filter F2 is preferably a square. Alternatively, the 
second YH extraction filter F2 may have a rectangular 
shape (a landscape or a portrait) . Further, coefficients 
are symmetrical with respect to the x and y-directions, 
so that an effect of filtering processing can be made 
uniform. Therefore, an image can be faithfully 
reproduced . 

In this manner, a YH extraction filter includes 
two filters, so that operations in the x and y-directions 
can be separated. This leads to easy hardware 
implementation. Figure 6 shows frequency 

characteristics of the first and second YH extraction 
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filters Fl and F2 of Figures 5A and 5B, and a frequency 
characteristic of a difference between the frequency 
characteristics of the first and second YH extraction 
filters Fl and F2. In Figure 6, graph h represents a 
frequency characteristic of the first YH extraction 
filter Fl, graph i represents a frequency characteristic 
of the second YH extraction filter F2, graph j represents 
a frequency characteristic of the middle-high-range 
luminance component YH which is a difference signal 
between graph h and graph i* In this example, although 
the YH extraction filter includes two filters, the YH 
extraction filter may include only one filter. In this 
case, filter coefficients are as shown in Figure 17 and 
calculation scale is increased. 

The multiplier 12 subjects the middle-high-range 
luminance component YH extracted by the middle-high- 
range luminance component extraction section 11 to 
auxiliary compensation in which the middle-high-range 
luminance component YH is multiplied by a gain a which 
is an adjustable coefficient. 

The adder 13 adds the middle-high-range 
luminance component aYH (YH multiplied by the 
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predetermined gain a) to the low- frequency luminance 
signal YL from the low-frequency luminance signal 
generation section 7 to a luminance signal (YL+aYH). 

The middle-range luminance component extraction 
section 14 extracts a middle-range luminance 
component ENH1 from the luminance signal (YL+aYH). The 
middle-range luminance component extraction section 14 
employs a middle-range luminance component extracting 
filter as shown in Figure 7A, for example. 

The high- range luminance component extraction 
section 15 extracts a high-range luminance 
component ENH2 from the luminance signal (YL+aYH). The 
high-range luminance component extraction section 15 
employs a high -range luminance component extracting 
filter as shown in Figure 7B, for example. The high- 
range luminance component extracting filter and the 
middle-range luminance component extracting filter may 
share a single filter using the same or different regions. 
Alternatively, two filters may be separately used, i.e. , 
one is for extracting high-range luminance components 
while the other is for extracting middle-range luminance 
components . 
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The multiplier 16 subjects the middle-range 
luminance component ENH1 to auxiliary compensation in 
which the middle-range luminance component ENH1 is 
multiplied by a gain (il which is an adjustable 
coefficient . 

The multiplier 17 subjects the high-range 
luminance component ENH2 to auxiliary compensation in 
which the high-range luminance component ENH2 is 
multiplied by a gain (32 which is an adjustable 
coefficient. 

The adder 18 synthesizes the luminance signal 
(YL+aYH) from the adder 13, the middle-range luminance 
component ((31ENH1) from the adder 16 , and the high-range 
luminance component (J32ENH2) from the multiplier 17 to 
perform contour emphasizing processing, thereby further 
improving the resolution of an image. 

Hereinafter, the principle of the present 
invention will be described in more detail. 

An improvement in resolution will be discussed 
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using a one-dimensional model. The optical low-pass 
filter 2 is provided at a light -receiving element surface 
side of the complementary color CCD area sensor 3 in order 
to suppress aliasing noise (Figure 1). Figure 8 shows 
an influence of the optical low-pass filter 2 on an 
frequency characteristic of image data. In Figure 8, 
graph a represents an ideal frequency characteristic of 
the optical low-pass filter 2, and graph b represents an 
actual frequency characteristic of the optical low-pass 
filter 2. Graph c shows an ideal frequency 

characteristic of a desired compensation filter for 
overcoming reductions in middle and high -range luminance 
components as shown by graph b. In the present invention, 
a compensation filter having a frequency characteristic 
substantially represented by graph Dl is used to newly 
extract a middle -high- range luminance component and 
combine it with middle to high-range luminance components 
at a predetermined ratio. 

Figure 9 shows frequency characteristics of 
filters compensating for middle-range luminance 
components, middle-high-range luminance components, and 
high-range luminance components. In Figure 9, graph D2 
represents a target frequency characteristic 
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corresponding to that represented by graph Dl of Figure 8 . 
Graph b represents a frequency characteristic of an image 
signal where middle -range to high-range luminance 
components are attenuated by influences of the optical 
low-pass filter 2 and interpolation • Graph c represents 
a frequency characteristic of a high-range luminance 
component compensating filter (Figure 7B). Graph d 
represents a frequency characteristic of a middle-range 
luminance component compensating filter (Figure 7A) • 
Graph e represents a frequency characteristic of a 
middle-high-range luminance component compensating 
filter (Figures 5A and 5B) . The middle -high-range 
luminance component compensating filter (Figure 5A and 
5B) is used as main emphasizing means, while the 
high-range luminance component compensating filter 
(Figure 7B) and the middle-range luminance component 
compensating filter (Figure 7A) are used as auxiliary 
compensating means. 

To discuss a transfer characteristic of an image 
processing apparatus quantitatively, the above- 
described two-dimensional filters are converted to 
one-dimensional equivalent filters (A) through (E) as 
shown in Figure 10 for the sake of explanation. 
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The first and second two-dimensional YH 
extraction filters Fl and F2 of Figures 5A and 5B can be 
converted to a one-dimensional filter (A) of Figure 10. 
A transfer function of the one-dimensional filter (A) of 
Figure 10 is represented by 

H(z)=z- 2 ' 5 -5z- 1 * 5 +4z-°- 5 +4z 0 - 5 -5z 1 ' 5 +z 2 ' 5 
= 8cos(0.5to)-10cos( 1. 5a))+2cos(2.5co) (19) 
where z=e j0> =cos ( co) + jsin( co) and co=2jtf. 

The two-dimensional high-range luminance 
component extracting filter of Figure 7B can be converted 
to a one-dimensional filter (B) of Figure 10 . A transfer 
function of the one-dimensional filter (B) of Figure 10 
is represented by 

H(z) = -z _1 +2-z 

= 2-2cos(co) ( 20 ) . 

The two-dimensional middle -range luminance 
component extracting filter of Figure 7A can be converted 
to a one-dimensional filter (C) of Figure 10. A transfer 
function of the one-dimensional filter (C) of Figure 10 



- 41 - 



01R00270 



is represented by 

H(z) = -z" 2 +2-z 2 

= 2-2cos(2co) (21). 

The two-dimensional filter for YeCyGrMg 
interporation of Figure 4 can be converted to a one- 
dimensional filter (D) of Figure 10. A transfer 
function of the one-dimensional filter (D) of Figure 10 
is represented by 

H(z)=z" 1 +2 + z 

= 2 + 2cos(2C0) (22) . 

The two-dimensional filter for obtaining the 
input luminance signal Yin can be converted to a one- 
dimensional filter (E) of Figure 10. A transfer 
function of the one-dimensional filter (E) of Figure 10 
is represented by 

H(z)= + z-°- 5 + z 0 * 5 

= 2cos(0.5co) (23) . 

Figure 11 shows frequency characteristics of 
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expression (19) for the one-dimensional middle-high- 
range luminance component extracting filter (A) of 
Figure 10 , expression (20) for the high-range luminance 
component extracting filter (B) of Figure 10 and 
expression (21) for the middle-range luminance component 
extracting filter (C) of Figure 10. In Figure 11, 
graph A represents a frequency characteristic of the 
middle-high-range luminance component extracting 
filter (A) of Figure 10, graph B represents a frequency 
characteristic of the high-range luminance component 
extracting filter (B) of Figure 10, and graph C 
represents a frequency characteristic of the middle-range 
luminance component extracting filter (C) of Figure 10. 
For the sake of comparison, graphs A through C are 
normalized. 

Figure 12 shows frequency characteristics of 
expression (22) for the one-dimensional low-frequency 
luminance signal generating interpolation filter (D) of 
Figure 10, and expression (23) for the YH extraction 
filter (E) of Figure 10. In Figure 12, graph D 
represents a frequency characteristic of the low- 
frequency luminance signal generating interpolation 
filter (D) of Figure 10, and graph E represents a 
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frequency characteristic of the YH extraction filter (E) 
of Figure 10. 

Figure 13 shows graph F representing a frequency 
characteristic of a luminance signal (YL+YH) obtained by 
compensating for the low- frequency luminance signal YL 
with the middle-high-range luminance component YH, and 
also shows again, for comparison, graph D representing 
a frequency characteristic of the low- frequency luminance 
signal YL. 

Figure 14 shows graph F representing a frequency 
characteristic of the luminance signal (YL+YH), graph B 
representing a frequency characteristic of the high-range 
luminance component compensating filter (B) of Figure 10, 
and graph C representing a frequency characteristic of 
the middle-range luminance component compensating filter. 
Adjustment of the gains a, pi and 02 (adjustable 
coefficients) of Figure 1 allows graph F to approach 
graph D2 of Figure 9 which is the target frequency 
characteristic. In this case, the luminance signal 
(YL+YH) is subjected to the middle-range luminance 
component compensation and the high-range luminance 
component compensation, rather than the middle-high- 
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range luminance component YH. This is because the 
luminance signal (YL+YH) has an S/N ratio higher than that 
of the middle -high-range luminance component YH. 

A luminance signal extracted by the optical 
low-pass filter 2 is compensated for mainly by the 
middle-high-range luminance component compensating 
filter having a frequency characteristic represented by 
graph e of Figure 9, and subordinately by the middle- 
range luminance component compensating filter having a 
frequency characteristic represented by graph d and the 
high-range luminance component compensating filter 
having a frequency characteristic represented by graph c . 
A frequency characteristic of a filter capable of 
compensating for the middle-high-range luminance 
component needs to have the maximum amplitude at an 
angular frequency co between Jt/2 to Jt and zero amplitude 
at an angular frequency co = jt. An even-number- size 
filter as represented in graph A of Figure 11 can meet 
such conditions . 

An odd-number-size filter is herein used as the 
YeCyGrMg interpolation filter of the low-frequency 
luminance signal generating interpolation section 4 for 
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the following reason. When the middle-high-range 
luminance component YH is added to the low- frequency 
luminance signal YL in the adder 13, positions of pixel 
data need to be aligned with each other . Specifically, 
as described above, the YH extraction filter of the 
middle-high-range luminance component extraction 
section 11 needs to have an even number size as described 
above. Moreover, the filter of the middle-high-range 
luminance component compensating luminance generation 
section 10 also has an even number size (2 pixels x 2 
pixels). Therefore, pixel data extracted by the 
middle -high- range luminance component YH is positioned 
at the center of each pixel. In this case, if the YeCyGrMg 
interpolation filter of the low-frequency luminance 
signal generating interpolation section 4 has an odd 
number size, pixel data of the low-frequency luminance 
signal YL can also be positioned at the center of each 
pixel* 

According to the above-described configuration, 
incoming light is subjected to sampling by the optical 
low-pass filter 2 so that the frequency components of the 
incoming light higher than or equal to 1/2 of the sampling 
frequency fs is cut out from the incoming light. The 
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resultant light enters via a complementary-color filter 
to the complementary color CCD area sensor 3 . Image data 
is read out from the complementary color CCD area sensor 3, 
missing components are obtained by interpolation of the 
image data by the low-frequency luminance signal 
generating interpolation section 4. The RGB generation 
section 5 generates R, G and B image signals including 
R-, G-, and B-components based on Ye-, Cy-, Mg-, and 
Gr-components which are complementary color image signals . 
Further, the R, G and B image signals are subjected to 
white-balance adjustment and then gamma correction. 
Based on the resultant signals, the low-frequency 
luminance signal generation section 7 generates the 
low-frequency luminance signal YL. 

Further, based on the gamma -corrected R, G and B 
image signals the color difference signal generation 
section 8 calculates the color difference signals Cr and 
Cb. Thereafter, the adaptive median filtering section 9 
selects a 5 x 5 pixel region when variations in the color 
difference signals Cr and Cb are small and selects a 3 
x 3 pixel region when variations in the color difference 
signals Cr and Cb are large, and subjects the color 
difference signals Cr and Cb to the adaptive median 
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filtering processing, in accordance with expression (17) , 
thereby removing noise from the color difference 
signals Cr and Cb and therefore preventing pseudo colors . 

On the other hand, the middle-high-range 
luminance component compensating luminance generation 
section 10 generates the input luminance signal Yin by 
adding Ye- , Cy- , Mg- , and Gr-components together in groups 
of four pixels. The middle-high-range luminance 
component extraction section 11 extracts the middle- 
high- range luminance component YH from the input 
luminance signal Yin using the middle-high-range 
luminance component extracting filter which is an 
even-number-mask- size band-pass filter. Further, the 
middle-high-range luminance component YH extracted by 
the middle-high-range luminance component extraction 
section 11 is multiplied by the gain a. The gain- 
adjusted middle-high-range luminance component aYH is 
added to the low- frequency luminance signal YL output 
from the low-frequency luminance signal generation 
section 7, thereby obtaining the luminance signal 
( YL+aYH ) • 

Further, the middle-range luminance component 
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extraction section 14 extracts the middle-range 
luminance component ENH1 from the luminance signal 
( YL+cxYH) • The high-range luminance component extraction 
section 15 extracts the high-range luminance 
component ENH2 from the luminance signal (YL+aYH) . The 
middle-range luminance component ENH1 is multiplied by 
the gain (51 while the middle-range luminance 
component ENH2 is multiplied by the gain (52* Thereafter, 
in the adder 18, the high-range luminance 
component piENHl and the middle -range luminance 
component (32ENH2 are synthesized with the luminance 
signal ( YL+cxYH) . Therefore, the luminance signal 
(YL+aYH) having a high S/N ratio is subjected to 
middle-range luminance component compensation and 
high-range luminance component compensation, whereby a 
sharper luminance signal is finally output* 

As described above, according to this example, a 
complementary color image signal is converted to R, G and 
B image signals by the RGB generation section 5. Based 
on the R, G and B image signals, the low- frequency 
luminance signal generation section 7 generates the 
low-frequency luminance signal YL for each pixel- To the 
low- frequency luminance signal YL is added the 
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middle-high-range luminance component YH extracted from 
the input luminance signal Yin by the middle-high-range 
luminance component extraction section 11. Therefore, 
the resultant image data can have color reproductivity 
higher than that of the color video camera using a 
complementary- color filter. Further, middle -high-range 
luminance components attenuated by the optical low-pass 
filter 2 and interpolation are compensated for. In 
addition, the middle-range luminance component 
extraction section 14 and high-range luminance component 
extraction section 15 are used to perform contour 
emphasizing processing, thereby making it possible to 
perform auxiliary compensation using a conventional 
compensation technique. Therefore, noise and jaggy 
occurring in sharpening processing can be efficiently 
suppressed. As a result, digital still images obtained 
in accordance with the principle of the present invention 
can be sharper images with low noise, jaggy, and pseudo 
colors, and have high resolution and color 
reproductivity . 

In this example, the RGB generation section 5 
converts a complementary color image signal (i.e.. Ye-, 
Cy-, Mg-, and Gr- component s ) to three primary color (R, 
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G and B) components in accordance with Ye=R+G, Cy=G+B, 
Mg=R+B, and Gr=G in groups of eight pixels. The present 
invention is not limited to this. Alternatively, the 
complementary color image signal (i.e., Ye-, Cy- , Mg-, 
and Gr- components) may be converted to R-, G-, and B- 
components in accordance with expression (24) below. By 
adjusting parameters Clj in expression (24), variations 
in image capturing ( CCD ) characteristics among 
manufacturers can be accommodated. 



will be further described. In the image processing 
apparatus, a complementary color image is output via the 
optical low-pass filter 2 from the complementary color 
CCD area sensor 3. In addition, the image processing 
apparatus includes the middle-high-range luminance 
component compensation section which compensates for 
attenuated middle and high-range luminance components in 




(24) 



The image processing apparatus of this example 
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a low- frequency luminance signal which is generated based 
on the complementary color image data and whose middle 
and high frequency components are attenuated from a 
frequency characteristic of an ideal low-pass filter. 
With this configuration, attenuated middle and high-range 
luminance components in a low-frequency luminance signal 
whose middle and high frequency components are attenuated 
from a frequency characteristic of an ideal low-pass 
filter are compensated for. As a result, image data 
having color reproductivity higher than that of 
conventional color video cameras using a 
complementary-color filter can be obtained. Further, 
noise and jaggy occurring in sharpening processing can 
be efficiently suppressed. 

As described above, according to the present 
invention, a middle-high-range luminance component in a 
low-frequency luminance signal which is attenuated from 
an ideal frequency characteristic of a low-pass filter 
in a range of lower than or equal to a predetermined 
frequency (half of the sampling frequency, i.e., fs/2) 
is compensated for. Therefore, noise and jaggy occurring 
in sharpening processing can be suppressed. 
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According to the present invention, a middle- 
high-range luminance component is compensated for , 
thereby obtaining images having a high resolution. In 
addition, noise and jaggy occurring in sharpening 
processing can be suppressed. 

According to the present invention, a middle- 
high-range luminance component having the zero amplitude 
at an angular frequency co = jt and the maximum amplitude 
at an angular frequency co between Jt/2 and jr can be easily 
obtained. 

According to the present invention, a uniform 
effect of filtering processing can be obtained, thereby 
making it possible to faithfully reproduce images. 

According to the present invention, operations in 
the x-direction and the y-direction can be separately 
performed, thereby reducing calculation scale. 
Therefore, the present invention can be easily realized 
by hardware. 

According to the present invention, 
complementary color data (i.e., Ye-, Cy- , Mg-, and 
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Gr-components) are added together in groups of four pixels 
to obtain a middle-high-range luminance component 
extracting luminance signal Yin. Therefore, losses in 
high-range luminance components can be minimized, thereby 
making it possible to obtain sharp images. 

According to the present invention, a middle- 
high- range luminance component of a low- frequency 
luminance signal is compensated for so that the center 
of the middle-high-range luminance component is 
positioned at the center of each pixel and low-frequency 
luminance components are positioned at the centers of 
pixels, thereby making it possible to prevent ghosts from 
occurring in reproduced images . 

According to the present invention, R, G and B 
image signals used in generating a low- frequency 
luminance signal can be easily obtained from a 
complementary color image signal. 

According to the present invention, variations in 
characteristics of image capturing elements among 
manufacturers can be accommodated by adjusting the 
parameters Cij of expression (24). 
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According to the present invention, by modifying 
a ratio of a middle-range luminance component to a 
high- range luminance component , the three-dimensional 
appearance of an image can be adjusted depending on user's 
preference* 

According to the present invention # median 
filters having different sizes are selected and used 
depending on the amount of change in a color difference 
signal, thereby making it possible to prevent occurrence 
of pseudo colors. 

Various other modifications will be apparent to 
and can be readily made by those skilled in the art without 
departing from the scope and spirit of this invention. 
Accordingly, it is not intended that the scope of the 
claims appended hereto be limited to the description as 
set forth herein, but rather that the claims be broadly 
construed. 



